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SBIR Data Reporting / Graphing requirements 

> Need interface to get/put information of school district, school region, school name, and class 
(with the option of retrieving this information directly from schools' student data files) 

> Need interface to assign students to test versions and computer terminals 

> Need to assign district, school region, school, class, and group ID and individual student ID 
numbers for storage and retrieval of data 

> Display data as shown in the tables and graphs 

> Display district, region, school, teacher, class, grade level on charts (see sample) 

> Display name Of 'test, CCI logo, copyright, disclaimer 

> Use different colors for pre-test and post-test bars on graphs (maximum display of two (2) most 
f=i recent test administrations) 

^ > Need interface to assign ID number for storage and retrieval of data 

. ^ > Display date of pre- and post- test, chronological age (date of test taken - date of birth), and grade 

1~ of the student for individual student reports. Pre-test and post-test dates need to be labeled (see 

L 5 samples). 



m 



SBTR Data Reports 

> There are three data report formats for class teachers to access and two more data report forms for 
school level and above. For individual parents, only individual student data summary is provided. 

S Class Data Graphs (see the report samples on pages 4-7). 

S Class Comparison with Multi-State Sample Average Tables (see the report samples on page 

S Individual Student Data Summary (see the report samples on pages 10-12: This report is a 
two-section table to show students' performance at their grade level and Full version level). 

^ District/Region/School/Class Data Graphs & Tables (see the report samples on pages 14-16). 
Click "region" at district level to link to the school level graphs and click "school" at region 
level will link to the class level graphs. Click pre-test/post-test bar will link to pre-test/post- 
test database tables. The database will have the function of retrieving all the (school/class) 
students' data with search and sort capabilities (e.g., search grade level = 1 and Blending 
Phonemes > = 3 : sort total score in descending order , etc.) The default fields for the table will 
be student name . 8 subtest total scores, total score for the test , and total time spent : 1 1 fields 
for pre-test and post-test respectively, (link interface design needs to be discussed with Noah) 

S Comparison of Regions/Schools/Classes to Multi-State Sample Average (see the report 
samples on pages 19-20) 

> Landscape will be the default print layout for all graphs. Portrait will be the default print layout for 
all tables. There should be an option of Landscape or Portrait for printing. 

> Teachers should be able to access a "first level button menu" from where they can click on the 
buttons to access the data they are interested and print the reports they need. The button's name 
reflects what information teachers can expect to get from this report. When the pointer moves 
inside the button area, a floating window showing the detail information about the reports in this 
branch (e.g., Answer your questions: What is the profile of relative strengths & weakness for my 
class ... - see document Hyperlink Descriptions). Reports are linked together. They can also be 
accessed by clicking on the buttons (hyperlinks) on another report. 

> There will be six buttons on the "first level button menu" screen. They are 
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• Average Score on All Test Sections (Graph) 

• Total Score Comparison (Graph) 

• Class Comparison with Multi-State Sample Average (Table) 

• Individual Student Data Summary (Table) 

• District/Region/School/Class Data Graphs & Tables 

• Comparison of Regions/Schools/Classes to Multi-State Sample Averages (Table) 

For individual packages (packages for parents), only Individual Student Data Summary report is 
needed. 

Class teachers can only access their students' data, so when they access the "first level button 
menu", buttons for the school and above levels are inactive. 

There will be a Back button and a Menu button on all the graphs and tables. Clicking on Back 
button to bring the user to the previous screen (where it comes from) and on Menu button to bring 
the user to the first level button menu for another option. 

There will be a Print button on each data report screen, where teachers can click to print the 
report(s). When they click the Print button, a window pops up and provides the choices of "Print 
All", "Print Current Student/Subtest", and "Print ..." 

• Print All: print all the reports of the form on the screen that the teacher is seeing. For example, 

if there are a total of 35 reports (students), they will all be printed at one time. 

• Print Current Student/Subtest: print the current report of the form on the screen that the 

teacher is seeing. For example, if there are a total of 35 students' records but on the 
screen that is Jim's report, only Jim's is printed out. 

• Print . . .: there should be a pull-down menu with all the registered students' names for student 

reports or subtest names for subtest reports listed. Teacher can click to choose those 
he/she needs to print out. For example, the teacher can choose to print Jim, Lynn, 
and Susan's reports from 35 students. 

Names on the X axis will be first initial + last name or full name (will be based on how many 
characters are acceptable for the database) 

Text on the X and )^axes can change directions 

For District/Region/School/Class data, the access permission will be as follows: 



Level 


Access 
Permission 


Grade level for comparison 


Kindergarteners 


First Graders 


Second Graders 


District access 


Districts 


✓ 




/ 


Regions 


✓ 


✓ 


/ 


Schools 




/ 






Region access 


Regions 


✓ 


S 


/ 


Schools 




S 


/ 




School access | Schools ✓ | ✓ | / 
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Formulas : 

Mean (Average): X = — V Xi where n = observations (subject number) 
n 



Standard Deviation: SD = J J^(xi-x) 2 

V n -1 



p Notes for Graphs and Tables: 

C : > Limited by space, the components of graphs are not proportionally sized. The layout of the graphs 

yQ on screens should be designed such that 1) font for title should be bigger; 2) title should be placed 

M= in the center across top; 3) use right shapes / graphics for buttons, for example, right arrow for Go 

P i Next; 4) allow enough space between components on the screen; 5) everything on the screen 

should visually please eyes and be readable; and 6) use color but no more than 4 colors on each 

ffi screen.) 

> For those gTaphs that cannot show all the data at a time (e.g., sample graphs 2 and 3 for class data), 
e there will be next and previous arrow buttons, and zoom-in and zoom-out buttons. Default for 

gj these graphs will be the first 1 0 records. Click the "next" arrow button to show the next 1 0 records 

SJ and "previous" arrow button to show the previous 10 records. Click on the "zoom-out" button to 

ml see all the data, and "zoom-in" button to go back to default graph. 

rP > For those graphs showing subtests on the x axis, the test item numbers should be variables. They 

S will change based on different versions (e.g., in the sample graph, there are 12 test items for 

|=4 ' Rhyming, the number 12 should change to 15 if there are 15 test items). 

> For all the bar graphs, there is a Data Values On/Off toggle button to provide the option of having 
or not having values on the graphs. 

> On some graphs and tables, there will be a cycle-through button (see samples). They can be 
clicked to cycle through the eight subtests, 6 grade level versions*, or the 35 students. (It will be 
replaced with a pull down / up menu for the user to select the items they'd like to have) 

> There should be somewhere on the screen to let the user know how to use the cycle-through 
buttons (or pull down/up menu) to see different graphs or tables, and toggle buttons to access 
different mode. 

> There will be a button on all the graph and table screens with the options of having a report 
displaying 1) all the test results, 2) Pre- test and the most recent post-test, and 3) the two most 
recent tests. (Definition: the first test is pre-test; the other tests are post-test (1 . . .n)) 

> Display corresponding test dates for individual student's test result reports. 



' Kindergarten, First Grade, Second Grade, GradeK Full (full test), Gradel_FuU, and Grade2_Full. 
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Class Data Graphs 

1 . Av^pe score on a 11 test sections (click on the subtest name (e.g.. Rhyming) to view more detailed 
results for that subtest (graph 3)) 

For whatever version of the test (KA, KB, 1 A, IB, 2A, 2B, FA, FB), the graph layout will be designed 
the same way; all the subtests will be displayed. However, only those available subtests will be 
highlighted (active); all the unavailable subtests will be inactive (gray out). 
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Average Score on All Test Sections 
Ms. Davis' Class 1Aat Central School 



p Re-Test g Fbst-Test 



CNJ 



88 88 88 

ruirrnHI till 

Rryrring First Souti Blendir^ Deletion Letter Nam; Letter Soind Phonetic Reading 
(12 items) Comparison (12 items) (12 item;) (26 item;) (26 item;) Decoding Fliency 
(12 item;) C 12iteffl5 ) l* 0 '**** 



t D) 90 

O C 80 

O E 70 

Oj C 60 

CD ™ 50 

8 £ 40 

c ,« 30 

g = 20 

& </) 0 

u - i_ Rryrring First Souti Blerdir^ Deletion litter Nam; Letter Soind Phonetic 

DistriaR (12 items) Comparison (12 item?) (12 item;) (26 item;) (26 item;) Decoding 

Region 
Report Date 



f Da^ta Values Oii7bff 7*1 j^^Display^p^nTS 



rr-TTifn fif--- 



* This is an example of having data values on. All the other graphs are examples having data 
values off. 
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Total score comparison (Student names will display evenly across the A' axis; Click on the student's 
name (e.g., J. Lambatos) to view individual student performance on all subtests (graph 4)) 



1 Back Menu 



Zoom In " ] r~Zoom-Out 



Total Score Comparison 
Ms. Davis' Class 1 A at Central School 



□ Pre-Test B Post-Test 






District 
Region 
Rqjort Date 




J. Lorrtoatos L. Westy J. Rrzadeh ABelkin D. Susler C. Boyton 



Data Values"On70ff 
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button to see the corresponding Table: Comparison with Multi-State Sample Averag 




*~ Back ' ' F Menu 



Rhyming 

Ms. Davis' Class 1A at Central School 



D Pre-Test ■ Post-Test 



o 
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4. Individual student performance on all subtests 
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Jack Lambatos (age 6-11) - All Test Sections 
Ms. Davis, Class 1A, Central School 



□ Re-Test g Fbst-Test 



District 
Region 
Pre-test: Date 
Post-test: Date 




Rtym'rg First Soinj B!erding Deletion Letter Nam; Letter Sound Fhonetic Reading 
(12 item;) Corrparison (12iterrs) (12 item;) (26 items) (26iterrs) Decoding Fliercy 
(12 item;) (12 item;) (40 item;) 



A ions_~ - I 



The above are sample Data Graph reports. Sub-test (e.g!, Rhyming), and student name (e.g., J. Lambatos) 
are clickable. When they are clicked, another graph will display on the screen. The following flowchart and 
table show the hyperlink behavior and the number of graphs for each level: 

Hyperlink behavior 



The down arrows ^ 
show the flow 
through clicking 
on subtests or 
student names; the 
up arrows ^ show 
the flow through 
clicking on the 
back button. 



Graph 1 



i 



Graph 3 


< > 


Table 





Graph 4 



Graph 2 
— z — 



Graph 4 



The back button 
on graph 4 should 
be able to go back 
where it comes 
from, that means, 
to recognize 
whether it comes 
from graph 2 or 3. 
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Number of gr a phs nn each level (Here number indicates the number of graphs for each individual single 
test version package) 



Graph (level) 


Number 


Name 


Graph 1 (level 1) 


1 


Average Score on All Test Sections 


Graph 2 (level 1) 


1 


Total Score Comparison 


Graph 3 (level 2) 


8 


Rhyming 






First Sound Comparison 






Blending 






Deletion 






Letter Names 






Letter Sounds 






Phonemic Decoding Accuracy 






Reading Fluency 


Graph 4 (level 2/3) 


35 (Max) 


Performance of Student name (age year - month) on All 
Test Sections 



ru 
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rnmpariso- ^ M„Ui-State Sample Average Table 

Clicking on this button will access an eight-button screen. «~nc g 
tables. The eight-button screen will include the following: 



Menu ] 



Rhyming 


Letter Names 


First Sound Comparison 


Letter Sounds 


Blending 


Phonemic Decoding Accuracy 


Deletion 


Reading Fluency 



f A, burtons it e Rhyming) to access the following table (Comparison with Multi-State 
the header of Post-Test is highlighted. 



Rhyming 

Comparison with Multi-State Sample Average 
Ms. Davis' Class 1A at Central School 



District 
Region 
Report Date 



Student 



Jack. Lambatos 



Leighton Pirzdeh 



Joe Susler 



Anna Boyston 



David Westy 



Multi-State Sample Average 



Christy Belkin 



15 
T5 



14 

7J 
7T 



15 
75 



10 



13 
74 



r ■ Menu 
L -i 



r Back ' Rhyming" 



Di^playOptiohsr, " " J 



• To see post-test scores in descending order compared with sample average, click on the header Post-Test. 
. Chck on each student's name to access Individual Student's Data Summary. 



1 Based on performance of n = 600 from CA, IL, FL. 
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Individual Student Data Summary 

This report can also be accessed through the "Individual Student Data Summary" button on the "first level 
button menu" screen. This report includes two test levels (grade level and full test) for each individual 
student. Items correct of the test taken, including test number and percentage, are shown in the table. 
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Test Report for Melissa (Kindergarten, Age 5-3) 



District 
Region 
School 
Report Date 



Test Sections 


Number 
of Test 
Items 


Items Correct 


Test Sample 
Average Scores 1 


Pre-Test 


Post-Test 


Date 


Date 


Kindergarten version 




No. 


% 


No. 


% 


Sample size = 


Rhyming 


12 


12 


100% 






Average 


First Sound Comparison 


12 


9 


75% 






Blending 


12 


6 


50% 






Deletion 


12 


9 


75% 






Letter Names 


26 


20 


77% 






Letter Sounds 


26 


20 


77% 






Full version 




Date 


Date 


Sample size F = 
Sample size KF = 
Sample size IF = 
Sample size 2F = 2 


No. 


% 


No. 


% 


Rhyming 


12 










Average F = 
Average KF = 
Average IF = 
Average 2F = 3 


First Sound Comparison 


12 










Blending 


12 










Deletion 


12 










Letter Names 


26 










Letter Sounds 


26 










Phonemic Decoding Accuracy 


12 










Reading Fluency 


40 











Display Options 



a 



1 Based on preliminary data gathered from sample (n = 450) in TN, OH, FL, and IL. 

2 Sample size F = (sample size of all those who took Full version); Sample size KF = (sample size of all K 
graders who took Full version); Sample size IF = (sample size of all first graders who took Full version); 
Sample size 2F = (sample size of all second graders who took Full version); For a student report, only 
Sample size F and the sample size for that student's grade (e.g., for kindergarten student report, show 
Sample size F and Sample size KF) need to be shown in the report. 

3 Average F = (Average score of all those who took Full version); Average KF = (Average score of all 
those K graders who took Full version); Average IF = (Average score of all those first graders who took 
Full version); Average 2F = (Average score of all those second graders who took Full version); For a 
student report, only Average F and the average for that student's grade (e.g., for kindergarten student 
report, show Average F and Average KF) need to be shown in the report. 
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Test Report for Juanita (First Grade, Age 6-10) 



District 
Region 
School 
Report Date 



Test Sections 


Number 


Items Correct 


Test Sample 
Average Scores 1 




of Test 


Pre-Test 


Post-Test 




Items 


Date 


Date 




First grade version 




No. 


% 


No. 


% 


n! = (sample size) 


Blending 


12 


10 


80% 






Xi = 


Deletion 


12 


12 


100% 








Phonemic Decoding Accuracy 


12 


9 


75% 








Reading Fluency 


40 


30 


75% 








Full version 




Date 


Date 


riF, nKF,niF,n2F 2 






No. 


% 


No. 


% 




Rhyming 


12 










Xf = 


First Sound Comparison 


12 












Blending 


12 










Xkf — 


Deletion 


12 










XlF = 


Letter Names 


26 










X2F- 


Letter Sounds 


26 










Phonemic Decoding Accuracy 


12 












Reading Fluency 


40 













Q 
yE3 



. 3U 

CP 



Display Options 



1 Based on preliminary data gathered from sample (n = 600) in CA, FL, and IL. 

2 n F = (sample size of all those who took Full version); n^ = (sample size of all K graders who took Full 
version); n, F = (sample size of all first graders who took Full version); n 2F = (sample size of all second 
graders who took Full version) 
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Test Report for Tyron (Second Grade, Age 7-9) 



District 
Region 
School 
Report Date 



Test Sections 


Number 


Items Correct 


Test Sample 




of Test 


Pre-Test 


Post- 


■Test 


Average Scores 1 




Items 


Date 


Date 




Second grade version 




No. 


% 


No. 


% 


n 2 = (sample size) 


Deletion 


12 


9 


75% 








Phonemic Decoding Accuracy 


12 


6 


50% 








Reading Fluency 


40 


32 


80% 










Full version 




Date 


Date 


Hf, nRF.niF.niF 2 






No. 


% 


No. 


% 




Rhyming 


12 










Xf = 


First Sound Comparison 


12 












Blending 


12 










Xkf = 


Deletion 


12 










X\F = 


Letter Names 


26 












Letter Sounds 


26 










X2F — 


Phonemic Decoding Accuracy 


12 












Reading Fluency 


40 













5 



tag 



Tyron 



Display Options 



1 Based on preliminary data gathered from sample (n = 600) in CA, FL, and IL. 

2 n F = (sample size of all those who took Full version); n^ = (sample size of all K graders who took Full 
version); n ]F = (sample size of all first graders who took Full version); n 2F = (sample size of all second 
graders who took Full version) 
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The above are sample Data Tables and Summary reports. Clicking on students' names and the cycle- 
toou^ bu«ons 3 move to another report. The following flowchart and table show the hyperhnk 
behavior and the number of reports for each level: 
Hyperlink behavior 



The down arrows ^ 
show the flow 
through clicking 
on subtest or 
student names; the 
up arrows ^ show 
the flow through 
clicking on the 
back button. 



Eight-button screen 



Students' Performance on Each subtest, 
comparison with sample average 



< > 



Cycle through eight subtests 



Individual student data summary 



< > 



Cycle through 35 students (Max) 



^w^p^nn each level (Here number indicates the number of graphs for each individual single 
test version package) 



Graph (level) 



Number 



Eight button level 



1 



N/A 



Report level 1 



"Rhyming: Comparison with Multi-State Sample Average 



First Sound Comparison: Comparison 
Sample Average 



Blending: Comparison with Multi-State Sample Average 



Deletion: Comparison with Multi-State Sample Average 



Letter Names: Comparison with Multi 
Average 



Letter Sounds: Comparison with 
Average 



Report level 2 



Phonemic Decoding Accuracy: Comparison 
State Sample Average 



Reading Fluency: Comparison with Multi-State Sample 
Average 



35 (Max) 



Test Report for Student name (age year-month) 
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District/Region/School/Class Data Graphs & Tables 

When the "Comparison of Regions/Schools/Classes to Multi-State Sample Average" button on the "first 
level button menu" screen is clicked, districts can directly access the following graph 1 ; regions can 
directly access the following graph 2; and schools can directly access the following graph 3. Lower level 
graphs can also be accessed through higher level graphs. 



o 



1 . For School Districts (click the region name to access the graphs for all the schools' data; click the bars 
to access database tables for pre-test/post-test scores, where teachers can use sort and search functions 
to sort/search region information needed) 



Back~ 



"Menu 



^^^^^ ^^^^^ 



Regions Comparison 
First Grade Averages, District 



100 



o 
o 
m 
a> 
ai 
n 

« 






m Pre-Test 
■ Post-Test 



Region 1 



Region 2 



Region 3 



Region 4 



"DWEab*eirOn70ff^ > First Grade ; ' 



, ni J i«Wf y - JJ ' 1 ' 

' Display Options j 
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2. For Regions (click the school name to access the graphs for all the school classes' data - three separate 
graphs of for Kindergarteners, for First Graders, and for Second Graders; click the bars to access 
database tables for pre-test/post-test scores, where teachers can use sort and search functions to 
sort/search school information needed) 



F Menu 



Back 



3 



~ T ZS6nri^tl rZoorivOuin 





Q 








Li 

a 


es 


ry 


o 

o 

CO 


Li 


rage 


Q 


Avei 


SJ 




f5 i 





Schools Comparison 
First Grade Averages, Region, District 



100 
90 
80 
70 
60 
50 
40 
30 
20 
10 
0 






rs] Pre-Test 
■ Post-Test 



School 1 



School 2 



School 3 



School 4 



l^atrabelfOWOff 



First Grade; P' "" Display Options _: 
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o 



3. For Schools (click the Performance Details button to access For School Performance Details graph; 
click the bars to access database tables for pre-test/post-test scores, where teachers can use sort and 
search functions to sort/search class information needed) 



Back" - f- " Menu 



f"Zo"6m IrT~1 \~ ZoohiOut ~) ^> 



r\-. 



Comparison of First-Grade Classes' Total Score Averages 
School, Region, District 






uPre-Test 
■ Post-Test 



Class 1 



Class 2 



.Class 3 



Class 4 



" Data Obels On/Off l *HFifst GFa<le^ f^P«^rnlince Befalls;*^ f^^bi^pi™Opti 



iorislll 



4. For School Performance Details (the test item numbers should be variables. They will change based on 
different versions (e.g., in the sample graph, there are 12 test items for Rhyming, the number 12 will 
change to 1 5 if there are 1 5 test items)). 




First-Grade Average Scores on All Test Sections 
School, Region, District 



□ Pre-Test g Post-Test 




Rhyrring First Sound Blending Deletion Letter Narre Letter Sound Phonetic Reading 
(12 items) Comparison (12 items) (12 items) (26 items) (26 items) Decoding Fluency* 
(12 items) (12 items) (40 items) 
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The above are sample Data Graph reports at district, region, and school levels. The following flowchart and 
table show the hyperlink behavior and the number of reports for each level: 

Hyperlink behavior 



U ! 

CO 
u 



The down arrows y 
show the flow 
through clicking 
on corresponding 
buttons; the up 
arrows ^ show the 
flow through 
clicking on the 
back button. 



For School Districts 



i 



For Regions 



For Schools 



1 



^ ^ Cycle through six grade versions 



^ ^ Cycle through six grade versions 



^ ^ Cycle through six grade versions 



For School Performance Details ^ ^. Cycle through six grade versions 



Number of reports on each level 



U 



Graph (level) 


Number 


Name 


For school districts (level 1) 


6 


Regions Comparison: Kindergarten Averages, District 






Regions Comparison: First Grade Averages, District 






Regions Comparison: Second Grade Averages, District 






Regions Comparison: GradeKFull Averages, District 






Regions Comparison: Gradel Full Averages, District 






Regions Comparison: Grade2_Full Averages, District 


For regions (level 2) 


6 


Schools Comparison: Kindergarten Averages, Region, 
District 






Schools Comparison: First Grade Averages, Region, 
District 






Schools Comparison: Second Grade Averages, Region, 
District 






Schools Comparison: GradeK Full Averages, Region, 
District 






Schools Comparison: Grade 1 Full Averages, Region, 
District 






Schools Comparison: Grade2_Full Averages, Region, 
District 


For schools (level 3) 


6 


Classes Comparison: Kindergarten Averages, School, 
Region, District 






Classes Comparison: : First Grade Averages, School, 
Region, District 






Classes Comparison: Second Grade Averages, School, 
Region, District 
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Classes Comparison: GradeKFull Averages, School, 
Region, District 






Classes Comparison: Gradel_Full Averages, School, 
Region, District 






Classes Comparison: Grade2_Full Averages, School, 
Region, District 


For school performance details 
(Level 4) 


6 


Kindergarten Average Scores on All Test Sections 
School, Region, District 






First Grade Average Scores on All Test Sections 
School, Region, District 






Second Grade Average Scores on All Test Sections 
School, Region, District 






GradeK Full Average Scores on All Test Sections 
School, Region, District 






Grade 1 Full Average Scores on All Test Sections 
School, Region, District 






Grade2 Full Average Scores on All Test Sections 
School, Region, District 



w 



■05 



P 



Comparison with multi-state sample averages across Regions/Schools/Classes 

There will be a button at the first level named Comparison of Regions/Schools/Classes to Multi-State 
Sample Average. Clicking on this button will access a three-button screen. Clicking on these buttons to 
access individual tables. The three-button screen will include the following: 



Menu 



Comparison across Regions 



Comparison across Schools 



Comparison across Classes 



When districts access to this screen all the buttons are active; when regions access this screen, Comparison 
across Regions are inactive; When schools access this screen, only Comparison across Classes button is 
active. Clicking on a button to access the following table accordingly. The default table will be Comparison 
on Rhyming. The pre-test scores are sorted in descending order with the sample mean and the header of 
Pre-Test highlighted as default. To see post-test scores in descending order compared with sample mean, 
click on the header Post-Test. Then the header of Post-Test is highlighted. Click on individual 
Region/school can access this region/school's Comparison with Multi-State Sample Average across 
Schools/Classes table. 
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Rhyming 

Comparison of Regions to Multi-State Sample Average 
Grade 1, Full, District 



Report Date 





Region 


N 


Mean Percentage Correct 


Pre-Test 


Post-Test 


1 


Region 3 


23 


90% 


92% 


2 


Region 5 


26 


88% 


88% 


3 


Region 2 


22 


86% 


90% 


4 


Region 1 


30 


86% 


89% 


5 


Region 6 


25 


79% 


79% 


+ 


•Multi-State Sample Average' ; - ; - 




78%. 




6 


Region 4 


26 


77% 


79% 













M 1 

03 



.<fc=3 



TBack ^TRhymin^^, 



'GraoelFull 



^Display Options 



• To see post-test scores in descending order compared with sample average, click on the header Post-Test. 

• Click on each region's name to access Comparison of Schools to Multi-State Sample Average. 

Rhyming 

Comparison of Schools to Multi-State Sample Average 

Grade 1 , Full, Region, District Re P ort Date 





School 


N 


Mean Percentage Correct 


, Pre-Test 


Post-Test 


1 


School 3 


23 


90% 


92% 


2 


School 5 


26 


88% 


88% 


3 


School 2 


22 


86% 


90% 


4 


School 1 


30 


86% 


89% 


5 


School 6 


25 


79% 


79% 




Multi-State Sample Average' 




78% 




6 


School 4 


26 


77% 


79% 












pMeTHFJ J^SclirJJ pRHyining; 1 ^"Gradel J ^ Display Options 



• To see post-test scores in descending order compared with sample average, click on the header Post-Test. 

• Click on each school's name to access Comparison of Classes to Multi-State Sample Average. 



1 Based on performance of n = 450 from CA, 1L, FL. 
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5_J 

'--A 

•H 

ru 



Rhyming 

Comparison of Classes to Multi-State Sample Average 
Grade 1, Full, School, Region, District 



Report Date 




Menu^ . 1 Back 

. To see post-test scores in descending order compared with sample average, click on the header Post-Test. 



The above are sample Data Table reports at district, region, and school levels. The following flowchart and 
table show the hyperlink behavior and the number of reports for each level: 

Hyperlink behavior 



The down arrows ^ 
show the flow 
through clicking 
on region/school 
names; the up 
arrows show the 
flow through 
clicking on the 
back button. 



Across regions 



Across schools 



< > 



Across classes 



€ > 



Cycle through eight subtests 
and six grade versions 

Cycle through eight subtests 
and six grade versions 



Cycle through eight subtests 
and six grade versions 



1 Based on performance of n = 450 from CA, IL, FL. 
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Number of reports on each level 



Table (level) 


Number 


Name 


ror scnooi Qismcis ^icvci 


8x6 


Rhyming: Comparison of Regions to Multi- State Sample 
Average 

Grade version, District 






First Sound Comparison: Comparison of Regions to 
Multi- State Sample Average 
Grade version, District 






Blending: Comparison of Regions to Multi-State Sample 
Average 

Grade version, District 






Deletion: Comparison of Regions to Multi-State Sample 
Average 

Grade version, District 






Letter Names: Comparison of Regions to Multi-State 
Sample Average 
Grade version, District 






Letter Sounds: Comparison of Regions to Multi-State 
Sample Average 
Grade version, District 






Phonemic Decoding Accuracy: Comparison of Regions 
to Multi-State Sample Average 
Grade version, District 






Reading Fluency: Comparison of Regions to Multi-State 
Sample Average 
Grade version, District 


For regions (level 2) 


8x6 


Rhyming: Comparison of Schools to Multi-State Sample 
Average 

Grade version, Region, District 






First Sound Comparison: Comparison of Schools to 
Multi-State Sample Average 
Grade version, Region, District 






Blending: Comparison of Schools to Multi-State Sample 
Average 

Grade version, Region, District 






Deletion: Comparison of Schools to Multi-State Sample 
Average 

Grade version, Region, District 






Letter Names: Comparison of Schools to Multi-State 

Sample Average 

Grade version, Region, District 
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Letter Sounds: Comparison of Schools to Multi-State 

Sample Average 

Grade version, Region, District 






Phonemic Decoding Accuracy: Comparison of Schools 
to Multi-State Sample Average 
Grade version, Region, District 






Reading Fluency: Comparison of Schools to Multi-State 

Sample Average 

Grade version, Region, District 


Pfir crhnnl*! {"level 3) 


8x6 


Rhyming: Comparison of Classes to Multi-State Sample 
Average 

Grade version, School, Region, District 






First Sound Comparison: Comparison of Classes to 

Multi-State Sample Average 

Grade version, School, Region, District 






Blending: Comparison of Classes to Multi-State Sample 
Average 

Grade version, School, Region, District 






Deletion: Comparison of Classes to Multi-State Sample 
Average 

Grade version, School, Region, District 






Letter Names: Comparison of Classes to Multi-State 
Sample Average 

Grade version, School, Region, District 






Letter Sounds: Comparison of Classes to Multi-State 
Sample Average 

Grade version, School, Region, District 






Phonemic Decoding Accuracy: Comparison of Classes 
to Multi-State Sample Average 
Grade version, School, Region, District 






Reading Fluency: Comparison of Classes to Multi-State 
Sample Average 

Grade version, School, Region, District 



a 



Ql 

m 

5 

B 
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Raw Scores and Response Time for Each Student (This design is for CCI research - data analysis) 



Student ID 



Student 1 



Response 



co)/i(or 



R(l)/NR(0y 



Test Ite m 1.1 ' 

Response Time (sec) 4 



Time Run-out 
0 



Student 2 



40 
2 



Student 3 



Student 4 



Student 5 



Student 6 



35 
20 



n 



Student 7 



Student 8 



Student 9 



20 
25 



01 



Mean correct 

> Individual student 
test mean for each 
test item category 


Standard Deviation 

> Standard Deviation for 

Individual student test of each 
test item category 


Mean Time 

Mean time for Individual 
student test of each test 
item category 


Other 

> - 


> Individual student 
subtest mean 


> Standard Deviation for 
. Individual student subtest 


Individual student subtest 
mean time 1 




> Individual student 
total test mean 


> Standard Deviation for 
Individual student total test 


Individual student total 
test mean time 




> Group mean for each 
test item 6 


> Standard Deviation for each 
test item in a group 


Group mean time for each 
test item 




> Group mean for each 
test item category 


> Standard Deviation for each 
test item category in a group 


Group mean time for each 
test item category 




> Group mean for each 
subtest 


> Standard Deviation for each 
subtest in a group 


Group mean time for each 
subtest 




> Group mean for total 
test 


> Standard Deviation for total 
test in a group 


Group mean time for total 
test 





1 One (1) to six (6) are used as students' response to test items; e.g., there are four choices for the test items 
in subtest one. They will be labeled as 1 to 4. If the student clicks the third picture, it will be recorded as 

3. Nine (9) is recorded as no response. 

2 One (1) for correct answer and 0 for incorrect answer. 

3 One (1) for having presented instructions twice and 0 for having presented instructions only once. 

« When mere is no response for 20 seconds, instructions will be repeated automatically; if there 1S no 
response for another 20 seconds, the screen flips to the next test item. No response will be coded « 0 
(incorrect) and time 40 seconds (see student 2). Instructions can only be repeated once. If ^e ^student 
clicks repeat button but does not answer the question for 20 seconds from the repeated instruction, the 
screen will flip to the next test item (see student 6). 

5 One (1) for time run-out (see student 2) and 0 for student spending 20 seconds to answer the question 
before the instruction is repeated (see student 7). 

6 Group mean for each test item will be for internal analysis only 
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Access to data 

> CCI has secured access to all the data recorded (need statement of security and permission) 

> School districts have secured access to their school district students' data 

> Regions have secured access to their region school students' data 

> Schools have secured access to their school students' data 

> Class teachers have secured access to their class students' data 

> Parents have secured access to their own children's data 

Other 

> 
> 



Include an On/Off option for limiting time allowed for user responses 
Include an On/Off option for limiting number of times instructions repeated 2 



1 Add disclaimers- Turning off limited time for response and/or limited repetition of instructions prevents 
valfd ^ssr^nt of skills and comparison of scores across subjects and comparison of pre-test vs. post-test. 
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